Non-rigid Objects Detection and Segmentation in Video Sequence Using 3d Mean Shift Analysis

نویسندگان

  • WEI FENG
  • RONG-CHUN ZHAO
چکیده

A new technique for robust detection and segmentation of non-rigid objects in video sequence is proposed in this paper. In our approach, spatio-temporal mean shift analysis (MSA) is employed to convert raw video/object data to their corresponding 3D/2D region feature spaces (RFS) respectively. The distance metric of RFS can be defined based on its spatio-temporal continuous property. Within the MSA derived RFS, any selected or given objects can be detected and segmented automatically in successive frames by local motion estimation. Experiments on various sequences show our method is robust to clutter, partial occlusion, object’s out-of-plane rotation and significant relative movement among targets, scene and camera.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Video Segmentation by Non-Local Consensus voting

We address the problem of Foreground/Background segmentation of “unconstrained” video. By “unconstrained” we mean that the moving objects and the background scene may be highly non-rigid (e.g., waves in the sea); the camera may undergo a complex motion with 3D parallax; moving objects may suffer from motion blur, large scale and illumination changes, etc. Most existing segmentation methods fail...

متن کامل

Video Pop-up: Monocular 3D Reconstruction of Dynamic Scenes

Consider a video sequence captured by a single camera observing a complex dynamic scene containing an unknown mixture of multiple moving and possibly deforming objects. In this paper we propose an unsupervised approach to the challenging problem of simultaneously segmenting the scene into its constituent objects and reconstructing a 3D model of the scene. The strength of our approach comes from...

متن کامل

Mosaic-Based Video Object Segmentation

Object segmentation is a problem within the scope of MPEG-4 standardization activities. This paper proposes a novel technique to extract the moving objects in the video sequences. Our approach is based on the integration of mosaic-based temporal segmentation and color-based spatial segmentation. The mosaic representation of video allows us to fully exploit the spatio-temporal information in the...

متن کامل

Joint Estimation of Object Motion and Point Light Illumination for 3D–Object–Based Analysis–Synthesis Coding

In video telephone scenes to be transmitted at low data rates non–diffuse scene illumination has to be expected. In this contribution, non–diffuse scene illumination and 3D object motion is estimated concurrently from a monocular image sequence. Image analysis uses the source model ”3D rigid moving objects with non–diffuse illumination”. The illumination is modeled by a distant point light sour...

متن کامل

SIDF: A Novel Framework for Accurate Surgical Instrument Detection in Laparoscopic Video Frames

Background and Objectives: Identification of surgical instruments in laparoscopic video images has several biomedical applications. While several methods have been proposed for accurate detection of surgical instruments, the accuracy of these methods is still challenged high complexity of the laparoscopic video images. This paper introduces a Surgical Instrument Detection Framework (SIDF) for a...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2003